Decision Theoretic Approaches to Experiment Design and External Validity∗
نویسندگان
چکیده
A modern, decision-theoretic framework can help clarify important practical questions of experimental design. Building on our recent work, this chapter begins by summarizing our framework for understanding the goals of experimenters, and applying this to re-randomization. We then use this framework to shed light on questions related to experimental registries, pre-analysis plans, and most importantly, external validity. Our framework implies that even when large samples can be collected, external decisionmaking remains inherently subjective. We embrace this conclusion, and argue that in order to improve external validity, experimental research needs to create a space for structured speculation. JEL Classifications: C93, D70, D80
منابع مشابه
Cognitive Economics in the Lab. The Power of Labels
It will be argued that the inclusion in the experimental design of contextual clues, such as “label” or “virtual simulations”, which make the laboratory task familiar, proved that problem solving in decision-making under uncertainty is environmentdependent. This supports the belief that the context-free experiment is not only an elusive goal, but also an inappropriate tool to investigate cognit...
متن کاملEvaluating the Evidence
Health outcomes research applies a wide range of methods to identify optimal approaches to determine optimal approaches to determine the effects of healthcare interventions and policies. Critical evaluation skills are necessary to navigate the evidence and identify studies that should influence clinical decision making and policy. A hierarchical “pyramid of evidence” that emphasizes randomized ...
متن کاملAchieving external validity in home advantage research: generalizing crowd noise effects
Different factors have been postulated to explain the home advantage phenomenon in sport. One plausible explanation investigated has been the influence of a partisan home crowd on sports officials' decisions. Different types of studies have tested the crowd influence hypothesis including purposefully designed experiments. However, while experimental studies investigating crowd influences have h...
متن کاملGroup Decision Making Under Risk: An Experiment with Student Couples
In an experiment, we study risk-taking of cohabitating student couples, finding that couples’ decisions are closer to risk-neutrality than single partners’ decisions. This finding is similar to earlier experiments with randomly assigned groups, corroborating external validity of earlier results. JEL Classification: C91; C92.
متن کاملBehavioral Experimentation and Game Theory in Engineering Systems Design
Game-theoretic models have been used to analyze design problems ranging from multi-objective design optimization to decentralized design, and from design for market systems to policy design. However, existing studies are primarily analytical in nature, which start with a number of assumptions about the individual decisions, the information available to the players, and the solution concept (gen...
متن کامل